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Abstract 

In this preliminary paper we study the stability 
property of a consensus on the average algorithm in 
arbitrary directed graphs with respect to commu¬ 
nication/sensing time-delays. The proposed algo¬ 
rithm adds a storage variable to the agents’ states 
so that the information about the average of the 
states is preserved despite the algorithm iterations 
are performed in an arbitrary strongly connected 
directed graph. We prove that for any network 
topology and choice of design parameters the con¬ 
sensus on the average algorithm is stable for suffi¬ 
ciently small delays. We provide simulations and 
numerical results to estimate the maximum delay 
allowed by an arbitrary unbalanced directed net¬ 
work topology. 

1 Introduction 

The consensus problem in multi-agent systems con¬ 
sists in the design of a coupling law between dynam¬ 
ical systems (agents) such that the state of each one 
converges to the same value in absence of external 
reference signals. Multi-agent systems are consid¬ 
ered to be complex systems since the pattern of 
interconnections between agents is often arbitrary 
and unknown at the controller design stage. This 
clearly makes challenging the design of interaction 
rules between agents that exploit only local infor¬ 
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mation. For these reasons agents modeled by sim¬ 
ple single integrators or second order systems are 
usually investigated. One of the major works from 
which we take inspiration is the one by m where 
the consensus problem for networks of first order 
agents for switching topologies or time-delays is in¬ 
vestigated. In this paper the authors prove that 
simple averaging local interaction rules can achieve 
consensus on the average, i.e., the state of each 
agent converges to the average of the initial states 
only if the directed graph that encodes the net¬ 
work topology is strongly connected and balanced 
(each agent receives and sends information to the 
same number of agents). They also explored the 
consensus problem in the case of time-delays for 
undirected network topologies. 

Since then several authors have explored ways 
to design consensus on the average algorithms that 
work on general directed graphs not necessarily bal¬ 
anced. In muni the idea to use an augment state 
space to add robustness to a networked system rep¬ 
resented by an undirected graph that executes a 
consensus algorithm was proposed. The proposed 
algorithms aim at recovering the correct network 
average once malicious or faulty agents have been 
removed from the network. 

In m ODQ a discrete time consensus on the aver¬ 
age algorithm for arbitrary strongly connected di¬ 
rected graph based on asynchronous state updates 
was presented, based on the idea to augment the 
state of each agent with an additional variable to 
preserve the information about the initial average 
of the states in the network. Simulations were used 
to characterize the convergence properties and the 
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performance of the algorithm. 

In [5] a discrete time consensus on the average 
algorithm based on additional state variables was 
characterized in terms of a tuning parameter. It 
was proven that there always exist sufficiently small 
values of such tuning parameter so that the pro¬ 
posed algorithm converges to the average of the ini¬ 
tial state in arbitrary strongly connected directed 
graphs. 

In [4] a consensus on the average algorithm for 
agents with uniformly quantized state and asyn¬ 
chronous updates in directed graphs was proposed. 

In [5] the authors address the control of dis¬ 
tributed energy resources by developing a consen¬ 
sus on the average protocol based on the so called 
ratio consensus. Their algorithm is based on two in¬ 
dependent distributed dynamical systems, one with 
arbitrary initial conditions and one with predeter¬ 
mined initial values. The authors consider time- 
varying network topologies described by directed 
graphs and show that for each agent the ratio of the 
output of these two dynamical systems converges to 
the average of the initial states. 

In [§, 7] the Corrective Consensus algorithm is 
proposed. It consists in a local state update rule 
where each agent keeps track of several additional 
variables corresponding to the number of its neigh¬ 
bors which are used to periodically steer the aver¬ 
age of the network state to the correct value corre¬ 
sponding to the average of the states at the initial 
instant of time. 

In [I] the broadcast gossip algorithm is proposed. 
This algorithm is based upon discrete time and 
asynchronous state updates with directed informa¬ 
tion flow, it makes each agent agree upon a random 
variable whose expectation is the average of the ini¬ 
tial states. 

Most of the literature on consensus on the av¬ 
erage in directed graphs deals with methods and 
techniques to achieve consensus on the average in 
networks of agents described by single integrators. 
On the other hand the literature on consensus with 
time-delays in directed graphs usually deals with 
the problem of making the state of each agent con¬ 
verge to the same value which can be time-varying 
and not related to the initial state of the network 
in an explicit way. 

in png necessary and sufficient conditions for con¬ 
vergence of second-order multi-agent systems with 
velocity feedback are given and the effect of time- 


delays in directed graphs is characterized. In m 
the consensus value is arbitrary. 

In P~5] several instances of consensus problems 
with time-delays are investigated. In particular the 
cases of switching directed topologies, packet data 
dropouts, and finite time consensus are all charac¬ 
terized separately by considering the effect of time- 
delays for the achievement of consensus on an ar¬ 
bitrary value. 

In this preliminary paper we propose a contin¬ 
uous time consensus algorithm inspired from the 
discrete time algorithms in manna. We con¬ 
sider a description in continuous time to describe a 
network of n vehicles with a local interaction rule 
that controls the instantaneous speed of each ve¬ 
hicle. Then we extend the proof method in [5j to 
the case at hand and study the convergence prop¬ 
erties of the resulting system considering a time- 
delay in the state update of each agent. We finally 
provide simulation results to corroborate the theo¬ 
retical analysis. 

The main contributions of this paper can be sum¬ 
marized in the following three items. 

• We provide a continuous time version of a 
consensus on the average algorithm for arbi¬ 
trary directed strongly connected graphs de¬ 
rived from results in mm an d 0. 

• We provide a characterization of the conver¬ 
gence properties of the algorithm with respect 
to time-delays. 

• We present simulations to characterize numeri¬ 
cally the performance of the proposed protocol 
with respect to different time-delays and tun¬ 
ing parameters. 

The paper is structured as follows. In Section [2] 
we introduce the notation and recall some prelim¬ 
inaries of algebraic graph theory. In Section [3] we 
introduce a consensus on the average protocol and 
the corresponding model considering time-delays. 
In Section []] we characterize the convergence prop¬ 
erties of the proposed algorithm with respect to 
time-delays. In Section [5] we corroborate the theo¬ 
retical analysis with a numerical example and sim¬ 
ulations. Concluding remarks are finally given in 
Section [G| 
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2 Preliminaries 

We now introduce some basic concepts of algebraic 
graph theory. The pattern of interactions among 
agents (nodes) is represented by a directed graph 
G = (V, £) where V = {1,..., n} is the set of nodes 
and £ C {V x V} is the set of directed edges. Node 
i receives information from node j only if (i,j) G £. 

The sets of in-neighbors and out-neighbors which 
represent the set of nodes from which each node 
receives or sends information are defined as TV);.,,,. = 
{j G V, (i,j) G £} and Af i>ou t = {j G V, (j,i) G £}, 
respectively. 

The topology of graph Q is encoded by the so- 
called adjacency matrix, annxn matrix A = [a^] 
whose elements are = 1 if (i,j) G £ and 0 oth¬ 
erwise. 

Let the in-degree and out-degree of node i 
be respectively = |TV) jin | and 8 ijOUt = 

\Afi,out\, where by |7V Mn | (|TV) iOUt |) we de¬ 
note the cardinality of set _A/i,i n (|TV) )0 «t|)- 
Let Din — diojjiS'i ,..., 8n,iri) and D 0 ut — 
diag(Si iOU t, . . ■ ,5 n:OU t ) be n x n diagonal matrices 
whose diagonal elements are respectively the in¬ 
degree and out-degree of the nodes. 

We now define the in-Laplacian matrix as Ci n = 
Di n — A and the out-Laplacian matrix as C ou t = 
D ou t — A. The in-Laplacian and out-Laplacian ma¬ 
trices of a directed graph have several structural 
properties. Due to the Gershgorin Circle Theo¬ 
rem applied to the rows of the in-Laplacian or 
the columns of the out-Laplacian it is possible to 
show that both matrices have eigenvalues with non¬ 
negative real part for any graph Q. By construction 
matrices Ci n and C ou t have at least one null eigen¬ 
value because either the row sum or the column 
sum is zero. Furthermore, let l n and 0„ be re¬ 
spectively the n-elements vectors of ones and zeros, 
then Ci n 1 = 0 and l 1 C ou t = o T . ifg is strongly 
connected, i.e., there exists a directed path that 
connects any pair of nodes in V, then the algebraic 
multiplicity of the null eigenvalue of both C m and 
C out is one. 


3 Consensus on the average 
protocol 

We now introduce a consensus protocol stated in 
continuous time that takes inspiration from pro¬ 


tocols appeared in m and [5] in a discrete time 
setting. In the protocol under consideration each 
agent is a single integrator with an additional state 
variable called surplus or storage. This additional 
variable is used to preserve information about the 
average value of the agents’ states at the initial in¬ 
stant of time, that is a time-varying quantity in 
directed graphs that are not balanced, i.e., graphs 
in which the in-degree and out-degree of each node 
are not necessarily equal. 

The local state update rule implemented by each 
node is the following: 

{ Xi{t) = - (*<(*) ~ x oi t )) + £Z i ( t )> 

Zi(t) = Y^jeK.in 

- EjeVi.in (*(*) ~ 

8i,in T ^z.out) Zi{t), 

(1) 

where Xi, Zi G R are the states of agent i and e G R + 
is a tuning parameter of the algorithm. It is clear 
that to implement protocol m each agent requires 
only relative state information with respect to vari¬ 
able Xi , absolute state information with respect to 
variable Zi, and knowledge of its own out-degree. 

The network dynamics that emerges when each 
agent implements the local state update rule in 
eq. 0 can be formulated in matrix form as follows: 


x(t) 


r — c fj 

’ x{t) ' 

z{t) _ 


fc'in out 

. . 


where x = [x\, x 2 , ■ ■ ■, x n ] and 2 = [ 21 , z 2 ,..., z n ] 
are a compact representation of the agents’ state. 

The proposed local interaction scheme can be in¬ 
terpreted as a network of n vehicles each modeled 
as a continuous time single integrator Xi = Ui(t) 
where each Xi(t) represents a position in space and 
variables Zi(t) are software variables which enable 
the interaction scheme to converge to the initial av¬ 
erage position. 

In this paper we study protocol © under the as¬ 
sumption that communication/sensing delays affect 
the multi-agent system. The network dynamics are 
thus described by 


x{t) 

z{t) 


M(e) 


X{t — T ) 

z{t - t) 


(3) 


with x(9) = xq, z{6) = zq, —t<9< 0, 
where 
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M{e) 


— C 

*~-'l 

r 

'-'in, 


el 

£out 


(4) 


and r £ R + denotes a time-delay. We study sys¬ 
tem © in the approximation that the delay for all 
the agent is the same. 


4 Convergence properties 

In thiconss section we study the convergence prop¬ 
erties of system ©. 

We preliminary observe that by construction ma¬ 
trix M[e) satisfies [l^ l£] M(e) = [0^ 0^] for any 
e £ K. Therefore, since 

Cx(f) + 1 £i(t) = 0, Vi > 0 


Proof: Matrix M(e) depends smoothly on 

parameter e > 0, therefore if eigenvalues 

A3(0),..., A2n(0) of Miff) have strictly negative real 
part, there exists e > 0 such that if £ £ [0, e] then 
for i = 3,..., 2n, it holds 5ft(Ai(e)) < 0. Therefore, 
as in IE we only have to show that for £ sufficiently 
small it is Ai(e) = 0 and 5R(A2(e)) < 0. 

Since the null eigenvalue o/M(0) is semi-simpl (0 
and Rank(M(0 )) = 2n — 2 it has two linearly inde¬ 
pendent right eigenvectors r \, r 2 and left eigenvec¬ 
tors l±, I 2 corresponding to the null eigenvalue. It 
holds 


M' = 


dM(e) 

d£ 


0 I 
0 -/ 


(7) 


Then, as shown in ffl, dAi(e)/de| e= o and 
<7A 2 (£)/cfe| £ =o are the eigenvalues of the following 


matrix 


it holds 


1 + 1 nZ{t) = l^x(0) + 1^(0), Vi > 0. (5) 


Now consider matrix M(e) for e = 0, namely 


M( 0) 



0 

£out 


( 6 ) 


' ijM'n ijM'r 2 1 

1% M'n I 2 M'r 2 \ ' 1 ' 

If graph Q is strongly connected then l± = ail 2n 
and r\ = ct 2 [l^, 0^] where «i, 0:2 £ K can he cho¬ 
sen such that ijri = 1. By substituting l\ and n 
in © it can be shown by simple computations that 


It is clear that since matrix M( 0) is a 2n x 2 n block 
lower triangular matrix it has 2n eigenvalues equal 
to the eigenvalues of matrices — and —C ou t- If 
graph Q is strongly connected, then M( 0) has one 
null eigenvalue with algebraic multiplicity 2 and ge¬ 
ometric multiplicity 2, all other eigenvalues have 
strictly negative real part. 

In the following we denote as Aj(0), i = 1,..., 2n, 
the eigenvalues of matrix M(0) and assume that 

0 = Ai(0) = A 2 (0) > K(A 3 )(0) > ... > 3J(A 2 „(0)). 

Eigenvalues of matrix M(e) are denoted as Ai(e), 
i = l,...,2n, and ordered as 3f(Ai)(e) > ... > 

R(A 2 „(e)). 

We now prove some properties of the eigenvalues 
of matrix M(e) for small values of e > 0, that can 
be derived from the results in [3j. 

Proposition 1 Let matrix M(e) be defined as in 
eq. ©. If Q is strongly connected, there exists 
£ £ R + such that if £ £ (0, e] then M(e) has one 
null eigenvalue and 2n — 1 eigenvalues with strictly 
negative real part. 


dAi(e)/de| e==0 = 0, dA 2 (e)/<fc| e =o = ^MV 2 . 


The first equality enables us to conclude that for 
sufficiently small values of e, it is Ai(e) = 0. 

Now, let Vr,out be the right eigenvector corre¬ 
sponding to the null eigenvalue of matrix C ou t and 
vi t i„ be the left eigenvector corresponding to the null 
eigenvalue of matrix Ci n . It is possible to verify by 
substitution that we can choose r 2 = [O^, vJ ou1 \ 


and I 2 = 


v 1 n J 

u l,ini u n 


Therefore, 


<7A 2 ir) / d£\e—Q — ^ l,in^r,out * 

Since Ci„ and C ou t are Metzler matrices (W), 
the eigenvectors lz^in and u^out corresponding to 
the null eigenvalue have only positive elements. 
Therefore 


d\2 (&)/de\ e= Q — Vfi n ^r,out ^ 0 

and A 2 (e) < 0 for e > 0 sufficiently small, thus 
proving the statement. □ 

1 An eigenvalue is semi-simple if its algebraic and geomet¬ 
ric multiplicity are equal. 
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We are now ready to study the stability of sys¬ 
tem Q with respect to time-delays. Let Y(s) = 
[X(s) T Z(s) t ] T denote the Laplace transform of 
y(t) = \x(t) T z(t) T ] T . Then the Laplace trans¬ 
form of system © is 

Y(s) = (si - M(e)e" ST )” 1 F(0) 

and the stability property of system © depends 
upon the roots of the quasi-polynomial 

det (si — M(e)e~ ST ). (9) 


therefore 

Ri(e) cos(6i{e) — uit) = 0, 
u) = Ri(e) sin{0i(e) — cut). 

This implies that 

9i(e) — ojt = — + kn, k £ N 

^ 7T 

to = Ri(e) sin(— + kn) = i?j(e)(—l) fc . 

Finally, considering only the top-half of the Gauss 
plane, di(e) £ ,7r] for * = 2 n. Thus 


By simple manipulations it holds 

det (si — M(e)e ~ ST ) = e~ 2nsT det (se ST I — M(e)) 

( 10 ) 

thus the roots of © correspond to the solutions of 
se ST = Aj(e), * = l,...,2n. (11) 


Theorem 1 Let matrix M(e) he defined as in 
eq. © and e £ (0,e] as in Proposition QJ If Q 
is strongly connected and 


t < T c (e) 


min 

i=2,...,2n 


gj(e) - f 

Ri(e) 


( 12 ) 


where Ri(e) = |Aj(e)| and &i(e) — ZAj(e) with A i(e) 
the i-th eigenvalue of M(e), then the roots of 


det(sI — M(e)e ST ) (13) 


have all strictly negative real part except one in s = 

0. 

Proof: By Proposition Q] since Q is strongly con¬ 
nected by assumption, there exists E such that for 
£ £ (0, e], M(e) has a single null eigenvalue and 
2n — 1 eigenvalues with strictly negative real part. 
Since the roots of eq. (USD depend continuously on r 
and for t = 0 they coincide with the roots of M(e), 
we compute the smallest positive value ofr, denoted 
as t c , for which at least one non-null root crosses 
the imaginary axis. By eq. (ED- assuming s = joj 
it holds 

juje JU]T = Ri{e)e j0i 

By simple manipulations the above equation can be 
rewritten as 


T c {e) 


= min min 

i=2,...,2n fceN 


9i(e) — § — kn 

Ri(e)(- l) fc 


= min 

i=2,...,2n 


9i(e) - f 
Ri(e) 


proving the statement. 


(14) 


□ 


Next we give bounds on the maximum length of 
the time delay that ensures stability as function of 
known network parameters computed for e = 0. If 
the actual time delay is smaller than the proposed 
bound then we are sure that there exist £ > 0 suf¬ 
ficiently small such that the system is stable and 
achieves consensus. 


Theorem 2 Consider a multi-agent system that 
implements protocol © in graph Q = {V,£}, with 
tuning parameter £ > 0, initial condition 2 ( 0 ) = 0„ 
and time-delay t > 0. If Q is strongly connected, 
there exists e such that if £ £ (0, e] and 

r<r=L,rc ta „(?L|™) 

where 

d — max{d,. irt , di,out\ 
i£V 

and Aa(0) is the rightmost non-null eigenvalue of 
matrix M(0), then 


lim x(t) 

£—>■00 


1^(0) 

J-n 


Proof: By definition it holds 


jui = Ri(e) cos(9i(£)—u!T)+jRi(£) sin(9i(£)—uiT), 


M(e) = M(0) + eM', 


6 







where M' is defined as in eq. ( 0 . Since M(e) can 
he seen as a perturbation of matrix M (0) its eigen¬ 
values depend continuously on parameter e. This 
implies that the ratio in eq. (in can he bounded 
for an arbitrary small £ as a function of the eigen¬ 
values of M( 0). In particular, for e = 0 by the 
Gershgorin disc theorem applied to matrices Ci n 
and C ou t we have Rife) < max I= i : . |A* (er) | < 

2maxj e v{^i,m, di.outf = 2<5, thus it holds 


min 

i—2,...,2n 


ft(g) ~ f 

Ri(e) 


minj= 2 ,...,2n g »( £ ) ~ f 
maXi = 2 ) ... j 2n Ri{s) 


1 

> —s arctan 

“ 2(5 


»(Ai(e)) 

mm „ ,, , „ 

i=l,...,2n 3(Ai(£)) 


Figure 1: 
\ion [5] 



The directed graph considered in Sec- 


Finally, since for e = 0 ; it is S(A 2 (e)) = 0 and 
max*=i l ... l2 „ |S(Aj(e))| < 5, it holds 


min 

i=2,...,2n 


djjs) - f 
Ri(e) 


1 

> —= arctan 
“ 26 




Therefore, since by Theorem Q] we may conclude 
that for t < t c (e) all the roots of eq. 0 have 
strictly negative real part except one, this also holds 
for a sufficiently small value of £ provided that 



Figure 2: Evolution of x(t) for e = 1.3 and r = 
0.19. 


1 

t < —= arctan 
26 


^{A3(0)} j 


T < T c (e). 


Therefore, the solutions x(t) and z{t) of system 
(ED converge to the null space of matrix M(e), i.e., 


lim 

t—> OO 


x{t) 

z[t) 


r i = a 


0, 



Time [sec] 


Since 1 ^x{t) + 1 f)z{t) 
t > 0 we have that 


„ ^ Figure 3: Evolution of z(t) for e = 1.3 and r = 0.19. 

0(0) + 0(0) for any 


0(0)+ 0(0) 

a = -. 

n 

Since by assumption *(0) = 0 n , it holds 

lim x(t ) = lnX ^ l n , 
t-y oo n 



thus proving the statement. 


g Figure 4: Real part of the rightmost non-null eigen¬ 
value of matrix M(e) with respect to e. 
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Figure 5: Real part of rightmost non-null root of Figure 7: Value of the real part of the rightmost 


eq. © with respect to r, for £ = 1.1. 


0.3c 
0.25 - 

, 0.2 . 

0.15. 

V.05 


0.55 


1.55 1.1 


Figure 6: The value of r c (e) with respect to e. 

5 Numerical example and 
simulations 

In this section we consider a numerical example to 
corroborate the theoretical results presented in the 
previous section. 

We consider the network of 6 agents whose topol¬ 
ogy is shown in Fig. [I] Such a network is encoded 
by the adjacency matrix 


A = 


0 10 10 1 
0 0 10 10 
0 10 10 1 
1 0 0 0 1 0 
0 1 0 0 0 1 
10 10 0 0 


(15) 


The in and out-Laplacian matrices are, respec¬ 
tively 


r — 
— 


2 

T—1 

0 

1 — 1 

0 

T—1 

0 

3 

-1 

0 

-1 

0 

0 

-1 

2 

-1 

0 

-1 

-1 

0 

0 

2 

-1 

0 

0 

-1 

0 

0 

2 

-1 

-1 

0 

-1 

0 

0 

3 


non-null root Xr of eq. © versus increasing e and 
time delay r. 

and 


£out - 


Fig. [2] shows the evolution of system ([3]) when 
e = 1.3 and r = 0.18. Initial conditions x(0) are 
chosen uniformly at random while initial conditions 
2(0) = 0 n . Fig. [2] shows how consensus on the 
average of the initial state x(0) is achieved. Fig. © 
presents the evolution of the storage variables z(t). 
All storage variables are initially set to zero and 
then vary during the dynamical evolution of the 
system so that the quantity l^x(t)+lnZ(t) remains 
constant. 

We now present the results of a series of numer¬ 
ical simulations whose aim is that of showing how 
the consensus achievement is related to parameters 
e and t. In particular, Fig. Q] shows how the right¬ 
most non-null eigenvalue Xr of matrix M (e) varies 
for e e [0.2,1.8]. Fig. [4] shows that there exists an 
optimal value at £ = 1.1 for which matrix M(e) in 
the given example has the smallest rightmost non¬ 
null eigenvalue. 

In Fig. [5] we show how the rightmost non-null 
root of eq. © varies for increasing values of the 
time-delay r when e = 1.1. Fig. [5] shows that de¬ 
spite the time-delay can make the system unstable, 


3 

-1 

0 

-1 

0 

-1 ' 

it can also improve the convergence speed to aver¬ 

0 

2 

-1 

0 

-1 

0 

age consensus. For this example the optimal value 

0 

-1 

3 

-1 

0 

-1 

of the time-delay is r = 0.19. 

-1 

0 

0 

2 

-1 

0 

Fig. [6] shows the values of r c in eq. (1141) for which 

0 

-1 

0 

0 

2 

-1 

eq. © has roots in the imaginary axis, i.e., it shows 

-1 

0 

-1 

0 

0 

2 

the maximum time delay sustainable by system 
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in eq. © for the considered network topology in 

Fig. [Q 

Finally, in Fig. [7] we show a plot of the real part 
of the rightmost non-null eigenvalue of eq. © for 
e 6 (0,2] and r £ [0,1]. Fig. [7] shows how the 
convergence properties are affected by parameters 
e and t: there exists an optimal value at e = 1.1 
and t = 0.19 for which is the most negative and 
there exists a connected region of the plane defined 
by e, t where Xr has strictly negative real part. 

The rightmost non-null root of eq. © for a given 
set of (e, t) is computed using the spectral method 
with the heuristic presented by [13] . 

6 Conclusions 

In this preliminary paper a continuous time version 
of a consensus on the average protocol for arbitrary 
strongly connected directed graphs is proposed and 
its convergence properties with respect to time de¬ 
lays in the local state update are characterized. 
The convergence properties of this algorithm de¬ 
pend upon a tuning parameter that can be made 
arbitrary small to prove stability of the networked 
system. Simulations have been presented to cor¬ 
roborate the theoretical results and show that the 
existence of a small time delay can actually improve 
the algorithm performance. 

Future work will include an extension of the 
mathematical characterization of the proposed al¬ 
gorithm to consider possibly heterogeneous or time- 
varying delays. 
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